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Abstract. We prove that the quantum group inclusion 0„ C O* is "maximal", where 
On is the usual orthogonal group and O* is the half-liberated orthogonal quantum group, 
in the sense that there is no intermediate compact quantum group 0„ C G C O*. In 
order to prove this result, we use: (1) the isomorphism of projective versions PO* ~ PC/„, 
(2) some maximality results for classical groups, obtained by using Lie algebras and some 
matrix tricks, and (3) a short five lemma for cosemisimple Hopf algebras. 



Introduction 



Quantum groups were introduced by Drinfeld [13] and Jimbo in order to study 
"non-classical" symmetries of complex systems. This was followed by the fundamental 
work of Woronowicz [19], [20] on compact quantum groups. The key examples which 
were constructed by Drinfeld and Jimbo, and further analyzed by Woronowicz, were 
g-deformations Gq of classical Lie groups G. The idea is as follows: consider the com- 
mutative algebra A = C{G). For a suitable choice of generating "coordinates" of this 
algebra, replace commutativity by the g-commutation relations ab = qba, where g > is 
a parameter. In this way one obtains an algebra Ag = C{Gq), where Gg is a quantum 
group. When q = 1 one then recovers the classical group G. 

For G = On,Un, Sn it was later discovered by Wang ^7], [TS] that one can also obtain 
compact quantum groups by "removing" the commutation relations entirely. In this way 
one obtains "free" versions , of these classical groups. This construction has 

been axiomatized in [11] in terms of the "easiness" condition for compact quantum groups, 
and has led to several applications in probability. See [9], [TO] . 

It is clear from the construction that one has G C G^ for G = On,Un, Sn- Since G~^ can 
be viewed a "liberation" of G, it is natural to wonder whether there are any intermediate 
quantum groups G G G' G G~^, which could be seen as "partial liberations" of G. For 
On, Sn this problem has been solved in the case of "easy" intermediate quantum groups 
fn\ . [H]. For Sn there are no intermediate easy quantum groups Sn G G' G S:^ . However 
for On there is exactly one intermediate easy quantum group 0„ C O* C 0+, called the 
"half-liberated" orthogonal group, which was constructed in [TTJ. At the level of relations 
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among coordinates, this is constructed by replacing the commutation relations ab = ha 
with the half-commutation relations abc = cba. 

In the larger category of compact quantum groups it is an open problem whether there 
are intermediate quantum groups Sn <Z G C S*^, or 0„ C G C with G 7^ O*. This 
is an important question for better understanding the "liberation" procedure of [TT]. At 
n = 4 (the smallest value at which Sn 7^ 5'^), it follows from the results in [5] that the 
inclusion Sn C is indeed maximal, and it was conjectured in [B] that this is the case, 
for any G N. Likewise the inclusion 0„ C O* C is known to be maximal at n = 2, 
thanks to the results of Podles in [16] . In general it is likely that these two problems are 
related to each other via combinatorial invariants [12] or cocycle twists [7]. 

In this paper we make some progress towards solving this problem in the orthogonal 
case, by showing that the inclusion On C O* is maximal. A key tool in our analysis will 
be the fact the "projective version" of O* is the same as that of the classical unitary 
group Un- By using a version of the five lemma for cosemisimple Hopf algebras (following 
ideas from [T], [3]), we are thus able to reduce the problem to showing that the inclusion 
of groups POn C PUn is maximal. We then solve this problem by using some Lie algebra 
techniques inspired from [1], [Ti] . 

The paper is organized as follows: Section 1 contains background and preliminaries. 
In Section 2 we prove that POn C PUn is maximal. In Section 3 we prove a short five 
lemma for cosemisimple Hopf algebras, which may be of independent interest. We then 
use this in Section 4 to prove our main result, namely that 0„ C O* is maximal. 
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supported by an NSERC Discovery grant and an ERA grant, and the work of S.C. was 
supported by an NSF postdoctoral fellowship and by the NSF grant DMS-0900776. 

1. Orthogonal quantum groups 

In this section we briefly recall the free and half-liberated orthogonal quantum groups 
from [T7], [TT], and the notion of "projective version" for a unitary compact quantum 
group. We will work at the level of Hopf *-algebras of representative functions. 

First we have the following fundamental definition, arising from Woronowicz' work |19] . 

Definition 1.1. A unitary Hopf algebra is a *-algebra A which is generated by elements 
{uij\l < i,j < n} such that u = (uij) and u = {u*j) are unitaries, and such that: 

(1) There is a *- algebra map A : A ^ A® A such that A{uij) = Ylk=i ® "^kj- 

(2) There is a *-algebra map e : A ^ C such that s{uij) = 6ij. 

(3) There is a *-algebra map S : A A°^ such that S{uij) = u*^. 

If Uij = M*- for 1 < i, j < n, we say that A is an orthogonal Hopf algebra. 
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It follows that A, £, S satisfy the usual Hopf algebra axioms. The motivating examples 
of unitary (resp. orthogonal) Hopf algebra is A = 71{G), the algebra of representative 
function of a compact subgroup G <Z Un (resp. G C 0„). Here the standard generators 
TXjj cire the coordinate functions which take a matrix to its (i, j)-entry. 

In fact every commutative unitary Hopf algebra is of the form TZ{G) for some compact 
group G C Un- In general we use the suggestive notation "A = 71(G)" for any unitary 
(resp. orthogonal) Hopf algebra, where G is a unitary (resp. orthogonal) compact quantum 
group. Of course any group-theoretic statements about G must be interpreted in terms 
of the Hopf algebra A. 

It can be shown that shown that a unitary Hopf algebra has an enveloping C*-algebra, 
satisfying Woronowicz' axioms in [19]. In general there are several ways to complete a 
unitary Hopf algebra into a C*-algebra, but in this paper we will ignore this problem and 
work at the level of unitary Hopf algebras. 

The following examples of Wang [LTj are fundamental to our considerations. 

Definition 1.2. The universal unitary Hopf algebra Au{n) is the universal *-algebra gen- 
erated by elements {uij\l < i,j < n} such that the matrices u = (uij) and u = {u*j) in 
Mn{Au{n)) are unitaries. 

The universal orthogonal Hopf algebra Ao{n) is the universal *-algebra generated by self- 
adjoint elements {uij\l < i,j < n} such that the matrix u = {uij)i<ij<n in Mn{Ao{n)) is 
orthogonal. 

The existence of the Hopf algebra structural morphisms follows from the universal 
properties of Au{n) and Ao{n). As discussed above, we use the notations Au{n) = TZiU^) 
and Ao{n) = 71(0^), where is the free unitary quantum group and is the free 
orthogonal quantum group. 

Note that we have 71(0^) 7Z{0n), in fact 7Z{0n) is the quotient of 7Z{0^) by the 
relations that the coordinates Uij commute. At the level of quantum groups, this means 
that we have an inclusion 0„ C 0+. 

In other words, 7Z{0^) is obtained from 7^(0„) by "removing commutativity" among 
the coordinates Uij. It was discovered in [TT] that one can obtain a natural orthogonal 
quantum group by requiring instead that the coordinates "half-commute" . 

Definition 1.3. The half-liberated othogonal Hopf algebra A*^{n) is the universal *-algebra 
generated by self-adjoint elements {uij\l <i,j< n} which half-commute in the sense that 
aba = aba for any a,b,c & {'^ij}> '^nd such that the matrix u = {uij)i<ij<n in Mn{A*^{n)) 
is orthogonal. 

The existence of the Hopf algebra structural morphisms again follows from the universal 
properties of A*{n). We use the notation A*^{n) = 7Z{0*^), where O* is the half-liberated 
orthogonal quantum group. Note that we have 7Z{0^) 7Z{0^) 7Z{0n), i.e. 0„ C 
O* C 0+. As discussed in the introduction, our aim in this paper is to show that the 
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inclusion On C O* is maximal. A key tool in our analysis will be the projective version 
of a unitary quantum group, which we now recall. 

Definition 1.4. The projective version of a unitary compact quantum group G C is 
the quantum group PG C U^2, having as basic coordinates the elements Vij^ki = UikU*ji- 

In other words, PlZiG) = 71{PG) C 7^(6*) is the subalgebra generated by the elements 
'Vij,ki = UikUji- It is clearly a Hopf *-subalgebra of 1Z{G). In the case where G C [/„ is 
classical we recover of course the well-known formula PG = G'/(G fl T), where T C ?7„ is 
the group of norm one multiples of the identity. 

The following key result was proved in |12]. 

Theorem 1.5. We have an isomorphism PO^ ~ PUn- 

Proof. First, thanks to the half-commutation relations between the standard coordinates 
on O*, for any a, b,c,d & {i^ij} we have abed = cbad = cdab. Thus the standard coordi- 
nates on the quantum group PO^ commute {ab ■ cd = cd ■ ab), so this quantum group is 
actually a classical group. A representation theoretic study, based on the diagrammatic 
results in [11], allows then to show this classical group is actually Pf/„. See [12]. □ 

Note that in fact the techniques developed in the present paper enable us to give a very 
simple proof of this theorem, avoiding the diagramatic techniques from [TT], [12]. See the 
last remark in Section 4. 

2. Classical group results 

In this section we prove that the inclusion POn C PUn is maximal in the category of 
compact groups (we assume throughout the paper that n > 2, otherwise there is nothing 
to prove). We will see later on, in Sections 3 and 4 below, that this result can be "twisted" , 
in order to reach to the maximality of the inclusion On C O*. 

Let On be the group generated by On and T ■ J„ (the group of multiples of identity 
of norm one). That is. On is the preimage of POn under the quotient map Un -» PUn- 
Let SOn C On be the group generated by SOn and T ■ /„. Note that 0„ = SOn if n is 
odd, and if n is even then On has two connected components and SOn is the component 
containing the identity. 

It is a classical fact that a compact matrix group is a Lie group, so SOn is a Lie group. 
Let 50n (resp. u„) be the real Lie algebras of SOn (resp. f/„). It is known that u„ consists 
of the matrices M e M„(C) satisfying M* = —M, and so„ = u„ fl M„(]R). It is easy to 

see that the Lie algebra of SOn is 50„ © iR. 
First we need the following lemma: 

Lemma 2.1. Ifn>2, the adjoint representation of SOn on the space of real symmetric 
matrices of trace zero is irreducible. 
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Proof. Let X G M„(]R) be symmetric with trace zero, and let V be the span of {UXU^ : 
U G SOn}- We must show that V is the space of all real symmetric matrices of trace 
zero. 

First we claim that V contains all diagonal matrices of trace zero. Indeed, since we 
may diagonalize X by conjugating with an element of SOn, V contains some non-zero 
diagonal matrix of trace zero. Now if D = diag{di, d2, ■ ■ ■ , dn) is a diagonal matrix in V, 
then by conjugating D by 



we have that V also contains diag{d2, di, d^, . . . , dn). By a similar argument we see that 
for any 1 < i, j < n the diagonal matrix obtained from D by interchanging di and dj lies in 
V. Since Sn is generated by transpositions, it follows that V contains any diagonal matrix 
obtained by permuting the entries of D. But it is well-known that this representation of 
Sn on diagonal matrices of trace zero is irreducible, and hence V contains all such diagonal 
matrices as claimed. 

Now if Y is any real symmetric matrix of trace zero, we can find a U in SOn such that 
UYU^ is a diagonal matrix of trace zero. But we then have UYU^ G V, and hence also 
y G V as desired. □ 

Proposition 2.2. The inclusion SOn C Un is maximal in the category of connected 
compact groups. 

Proof. Let G be a connected compact group satisfying SOn C G C Un- Then G is a Lie 
group, let g denote its Lie algebra, which satisfies sOn © C g C u^. 

Let ado be the action of G on g obtained by differentiating the adjoint action of G on 
itself. This action turns g into a G-module. Since SOn C G, g is also an S'G„-module. 

Now if G 7^ SOn, then since G is connected we must have so„ ©iM 7^ g. It follows from 
the real vector space structure of the Lie algebras Un and so„ that there exists a non-zero 
symmetric real matrix of trace zero X such that iX G g. 

But by Lemma 12.11 the space of symmetric real matrices of trace zero is an irreducible 
representation of SOn under the adjoint action. So g must contain all such X, and hence 
g = u„. But since Un is connected, it follows that G = Un- □ 

Our aim is to extend this result to the category of compact groups. To do this we need 
to compute the normalizer of SOn in Un, i.e. the subgroup of Un consisting of unitary U 
for which U~^XU G SOn for all X G SOn- For this we need two lemmas. 

Lemma 2.3. The commutant of SOn ^n(C), denoted SO'^, is as follows: 





(2) Ifn>3, SO'n = {aln,ae C}. 



6 



TEODOR BANICA, JULIEN BICHON, BENOiT COLLINS, AND STEPHEN CURRAN 



Proof. At n = 2 this is a direct computation. For n > 3, an element in X G SO'^ 
commutes with any diagonal matrix having exactly n — 2 entries equal to 1 and two 
entries equal to —1. Hence X is a diagonal matrix. Now since X commutes with any even 
permutation matrix and n > 3, it commutes in particular with the permutation matrix 
associated with the cycle k) for any 1 < i < j < k, and hence all the entries of X 
are the same: we conclude that X is a scalar matrix. □ 

Lemma 2.4. The set of matrices with non-zero trace is dense in SOn- 

Proof. At n = 2 this is clear since the set of elements in 5*02 having a given trace is finite. 
Assume that n > 2 and let T e SOn ^ 50(M") with Tr(T) = 0. Let E C M" be a 
2-dimensional subspace preserved by T and such that T\e G S0{E). Let e > and let 
S, G SO{E) with \\T\E - ^.11 < e and Tr{T\E) Tr{S,) {n = 2 case). Now define T, G 
SO{'R"') = SOn by T^\E = S^ and T^ie^ = T^e^. It is clear that ||T — Te|| < ||T|^ — S'^H < e 
and that Tr(T,) = Tr{S,) + Tr{T\Ei-) ^0. □ 

Proposition 2.5. 0„ is the normalizer of SOn Un. 

Proof. It is clear that On normalizes SOn, so we must show that if f/ G [/„ normalizes SOn 
then U G On- First note that U normalizes SOn- Indeed if X G SOn then U~^XU G SOn, 
so U-^XU = AF for A G T and Y G SOn- If Tr(X) ^ 0, we have A G M and hence 
\Y = U^^XU G SOn- The set of matrices having non-zero trace is dense in SOn by 
Lemma 12.41 so since SOn is closed and the matrix operations are continous, we conclude 
that U^^XU G SOn for all X G SOn- 

Thus for any X G SOn, we have {UXU-^iUXU-'^) = In and hence X^U^UX = U^U - 
This means that U^U G SO'^- Hence if n > 3, we have U^U = ain by Lemma [2.31 with 
a G T since U is unitary. Hence we have U = a^^'^{a~^^'^U) with a~^^'^U G On, and 
U G On- If n = 2, Lemma 12.31 combined with the fact that {U'^Uy = U^U gives again 
that U^U = a/2, and we conclude as in the previous case. □ 

We can now extend Proposition 12.21 as follows. 

Proposition 2.6. The inclusion On C Un is maximal in the category of compact groups. 

Proof. Suppose that 0„ C G C f/„ is a compact group such that G Un- It is a well 
known fact that the connected component of the identity in G is a normal subgroup, 
denoted Gq- Since we have SOn C Go C f/„, by Proposition 12.21 we must have Gq = SOn- 
But since Gq is normal in G, G normalizes SOn and hence G C 0„ by Proposition 12. 51 □ 

We are now ready to state and prove the main result in this section. 

Theorem 2.7. The inclusion POn C PUn is maximal in the category of compact groups. 

Proof. It follows directly from the observation that the maximality of 0„ in f/„ implies the 
maximality of POn in PUn- Indeed, if POn C G C PUn were an intermediate subgroup, 
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then its preimage under the quotient map [/„ -» Pf/„ would be an intermediate subgroup 
of On C Un, contradicting Proposition 12.61 □ 

3. A SHORT FIVE LEMMA 

In this section we prove a short five lemma for cosemisimple Hopf algebras (Theorem 
3.4 below), which is a result having its own interest, to be used in Section 4 below. 

Definition 3.1. A sequence of Hopf algebra maps 

B ^ L 

is called pre-exact if i is injective, p is surjective and i{A) = H'^"^, where: 

A^"P = {a G A\{id®p)/^{a) = a ® 1} 

The example that we are interested in is as follows. 

Proposition 3.2. Let A he an orthogonal Hopf algebra with generators Uij. Assume that 
we have surjective Hopf algebra map p : A ^ CZ2, Uij — )■ Sijg, where < g >= Z2. Let PA 
be the projective version of A, i.e. the subalgebra generated by the elements UijUki with 
the inclusion i : PA C A. Then the sequence 



^ PA ^ A A CZ2 ^ c 



is pre-exact. 
Proof. We have: 



{id^p)A{ui,j,...Ui^jJ 



"nil • • • '"imim ® 1 if m is even 



Uhji ■ ■ ■ Ui^jm ®9 if is odd 
Thus iP^°P is the span of monomials of even length, which is clearly PH . □ 

A pre-exact sequence as in Definition 3.1 is said to be exact [2] if in addition we have 
i{A)^H = ker(7r) = Hi{A)~^, where i{A)'^ = i{A) fl ker(£). The pre-exact sequence in 
Proposition 3.2 is actually exact, but we only need its pre-exactness in what follows. 

In order to prove the short five lemma, we use the following well-known result. We give 
a proof for the sake of completness. 

Lemma 3.3. Let 9 : A ^ A' be a Hopf algebra morphism with A, A' cosemisimple and 
let hA,hAi be the respective Haar integrals of A, A'. Then 6 is injective iff h^/O = h^- 

Proof. For a G A, we have: 

e{hA'{e{ai))a2) = hA>{e{a)i)e{a)2 = e{hA'e{a)l) 

Thus if 6 is injective then h^'O is a Haar integral on A, and the result follows from the 
uniqueness of the Haar integral. 
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Conversely, assume that Ha = hA>0. Then for all a,b G A, we have hA{xy) = 
hA'{0{a)9{h)), so if 9{a) = 0, we have hA{oh) = for all b E H. It follows from the 
orthogonality relations that a = 0, and hence 6 is injective. □ 

Theorem 3.4. Consider a commutative diagram of cosemisimple Hopf algebras 

k > B — ^ A L > k 

e 

k > B A' L > k 

where the rows are pre- exact. Then 9 is injective. 

Proof. We have to show that Ha = hA'9, where Ha, hA' are the respective Haar integrals 
of y4, A' . Let A be the set of isomorphism classes of simple L-comodules and consider the 
Peter- Weyl decomposition of L: 

L = 0L(A) 

AeA 

We view A as a right L-comodule via {id ® 7r)A. Then A has a decomposition into 
isotypic components as follows, where Ax = {a E A \ {id® t:) o A(a) E A® L{\)}: 

A = ®A, 

AeA 

It is clear that Ai = A'^°^ . Then if A 7^ 1, we have hA{A\) = 0. Indeed for a G A\, we 
have: 

ai I® 7r{a2) E H L{X) =^ hA{a)l = n{hH{ai)a2) E L{\) =^ /^^(a) = 

Since tt'O = vr, it is easy to see that 0{Ax) C A'^ and hence for A 7^ 1, Ha'ia'^ = hA'0\A^ = 
= hA\Ax- For A = 1, we have i{A) = Ai and 6 is injective on i{A) since 6i = i'. Hence 
by Lemma 1X51 we have hA'0\Ai = Ha^ = hA\Ai- Since A = ©asa^a we conclude Ha = hA'd 
and by Lemma [3.31 we get that 6 is injective. □ 

4. The main result 
We have now all the ingredients for stating and proving our main result in this paper. 

Theorem 4.1. The inclusion On C O* is maximal in the category of compact quantum 
groups. 

Proof. Consider a sequence of surjective Hopf *-algebra maps as follows, whose composi- 
tion is the canonical surjection: 

A:{n) 4 A 4 n{On) 
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By Proposition 3.2 we get a commutative diagram of Hopf algebra maps with pre-exact 
rows: 

^ Kin) 



f\ 

-> PA 

pn{On) 



■> 



«3 



A 



P2 



P3 



Consider now the following composition, with the isomorphism on the left coming from 
Theorem 1.5: 

n{PUn) ^ PAiin) A PA 4 P7^(o„) ~ 7^(P0„) 

This induces, at the group level, the embedding P0„ C PUn- By Theorem 12.71 f\ or g\ 
is an isomorphism. If f\ is an isomorphism we get a commutative diagram of Hopf algebra 
morphisms with pre-exact rows: 



PA*(n) 



PA*(n) 



«20/| 



-> Alin) 
/ 



P2 



> CZo 



c 



Then / is an isomorphism by Theorem 3.4. Similarly if g\ is an isomorphism, then g is 
an isomorphism. □ 

Observe that the technique in the proof of Theorem 14.11 also enables us to prove that 
PO* ^ PUn independently from [12]. Indeed, since PAl{n) is commutative, there exists 
a compact group G with PAl{n) 



n{G) and P0„ C G C PUn- Then Theorem O 
gives G = POn OT G = PUn- If G = P0„, then as in the proof of Theorem 14. H Theorem 

TZ{On) is an isomorphism, which is false since Al{n) is a not 

PUn. 



[331 gives that Al{n) 
commutative if n > 2. Hence G 
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